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ABSTRACT 


The Symmetric Primal-Dual Symplex Pivot Decision Strategy (spdspds) is a novel iterative 
algorithm to solve linear programming problems. A symplex pivoting operation is considered 
simply as an exchange between a basic (dependent) variable and a non-basic (independent) 
variable, in the Goldman-Tucker Compact-Symmetric-Tableau (CST) which is a unique symmetric 
representation common to both the primal as well as the dual of a linear programming problem in 
its standard canonical form. From this viewpoint, the classical simplex pivoting operation of 
Dantzig may be considered as a restricted special case. 


The infeasibility index associated with a symplex tableau is defined as the sum of the number of 
primal variables and the number of dual variables that are infeasible. A measure of goodness as a 

of a pivot selection is defined/determined as/by the decrease in the 
infeasibility index associated with such a pivot selection. The selection of the symplex pivot 
element is made by seeking the best possible anticipated decrease in the infeasibility index from 
among a wide range of candidate choices with non-zero values - limited only by considerations of 
potential numerical instability. After passing through a ise Seca aaron 
the algorithm terminates when further reduction in the infeasibility index is not possible; then the 
tableau is checked for the terminal tableau type to facilitate the problem classification - a 
termination with an infeasibility index of zero indicates optimum solution. Even in the absence of 
an optimum solution, the versatility of the spdspds algorithm allows one to explore/determine the 
most suitable alternative solutions, including possibly a comprehensive parametric analysis, etc. 
The worst-case computational complexity of the spdspds algorithm is shown to be O(L'>) where L 
refers to the problem-size expressed in terms of the size(length) of the input data. 


Keywords: optimization, linear programming, algorithm, simplex, symplex, 
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1. INTRODUCTION 


Linear Programming (LP) problem represents one of the most widely used class of computational 
models, for which any possible improved solution technique would certainly be highly desirable. 
Of course, there has been several alternative solution strategies suggested including the classical 
simplex method of Dantzig [1] and several variations thereof, followed by recent polynomial time 
algorithms, namely the Ellipsoid Method of Khachiyan [2] [3] and the Karmarkar Algorithm [4] - 
both classified now as belonging to Interior Point Algorithms. Terlaky [5] Todd [6] and Adler et 
al [7] present a summary view of the various developments as well as a projected futuristic view of 
the overall situation. Let us not get diverted much into the historical developments etc. 


The simplex pivoting operation of Dantzig represents a move from one basis/tableau to another 
basis/tableau, by/through a single exchange between an entering infeasible non-basic variable and 
a leaving feasible basic variable. For a chosen entering infeasible non-basic variable, the leaving 
feasible basic variable is to be selected so as to meet certain restrictive criteria in terms of the 
corresponding limitation of moving only between two neighboring extreme/vertex points of the 
polytope defined by the set of linear system of inequalities - so as to maintain feasibility while 
improving the objective function value by moving further towards the optimum. 


The actual selection of a spdspds pivot element is governed by an analysis of the associated measure 
of goodness of such a pivot choice. A global measure of goodness or a 
(gem) for pivot selection is defined, utilizing the novel concept of infeasibility index associated 
with a symplex tableau - defined as the sum of the number of primal variables and the number of 
dual variables that are infeasible. The change in the infeasibility index associated with a symplex 
pivot element can be determined by a thorough analysis of the tableau data. To guarantee the best 
computational performance, it is proposed to select a pivot element corresponding to the best 
possible decrease in the infeasibility index. 


It will be shown that the spdspds algorithm passes through a non-repeating sequence of CST 
tableaus and reaches a terminal tableau wherefrom no further reduction in the infeasibility index is 
possible. The length of such sequence is limited by the infeasibility index of the initial tableau, 
except for cases of degeneracies that may possibly cause certain elongated sequence. An analysis 
of the data pattern in the terminal tableau can be used to classify the problem into one of the 
possible six categories - an infeasibility index of zero indicates optimum solution. Even in the 
absence of an optimum solution, the spdspds algorithm allows one to explore/determine the most 
suitable alternative solutions, including a comprehensive parametric analysis, etc. 
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2. GOLDMAN-TUCKER COMPACT-SYMMETRIC-TABLEAU 


We will go through some well-known preliminaries for the sake of establishing the notational 
conventions used in this report, as used in our earlier reports [8] and [9]. 


The Symmetric Primal-Dual Pair of LP in the Standard Canonical Form [10] is as follows: 


Primal Problem: 


maximize C.X = f 
s.t. Ax < b (1) 
x = 0 
Dual Problem: 
minimize v.b = g 
s.t. vA = Cc (2) 
Vv = 0 


The descriptions for each of the problem parameters in (1) & (2) above are as follows: 


x Primal decision variables nx 1 vector 
c Primal objective function coefficients 1 x n vector 
f Primal objective function value 1 x 1 scalar 
A Primal constraint coefficient matrix m X n matrix 
b Primal constraint upper bound m x 1 vector 
Vv Dual decision variables 1 x m vector 
g Dual objective function value 1 x 1 scalar 


We introduce the m x | vector y of slack variables to (1) and the 1 x n vector u of surplus variables 
to (2) to write the symmetric primal-dual pair in canonical form as follows: 


Primal Problem: 


maximize c.x +0.y = f 
s.t. A.x + Imny = b (3) 
xX, y 2 0 
Dual Problem: 
minimize v.b +u.0 = g 
s.t. v.A —ulh = Cc (4) 
v,u = 0 


This Symmetric Primal-Dual pair is represented in the Goldman-Tucker Compact Symmetric 
Tableau (CST) as shown in Figure-1. 
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Xj —1 
Vi aij bi = -Yi 
—| Cj 0 =f 

I H 

uj g 


Figure-1: Initial Compact Symmetric Tableau (To) 


The relations in (3) & (4) corresponding to the Primal and Dual can be combined to give - 


cxtu.x = vAX = v.b-v.y (5) 


f +ux = vAK = g -v.y (6) 


For any feasible (basic or non-basic) solution to the P-D pair, 


U, X, V, Y > 0 (7) 
and therefore, 

(g¢-f) = (uxt+vy) = O (8) 
For ( ) to the P-D pair, 
the ; 
that is, 

u,y = 0 (9) 

and therefore, 

(g-f) = (ux+vy) = O (10) 


The entries in the Goldman-Tucker Compact-Symmetric-Tableau (CST) directly correspond to 
the associated basic solution to the P-D pair, thus establishing a 

between a and the associated Goldman-Tucker Compact-Symmetric-Tableau (CST). 
A pivoting operation on the CST tableau corresponds to the associated move from one basis to 
another. 


For the LP problem P-D pair (1) & (2) or equivalently (3) & (4) the above tableau in Figure-1 
ae the initial tableau indicating the initial basic solution (IBS) wherein 


associated ( with vi the 
whereas x; are the 
uj; the . Note that the x; (along with the label —1 for the RHS 
column) and the vi (along with the label —1 for the objective function row) play a 
significant role in the CST tableau, and the way to interpret (read) the CST tableau is as follows: 
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Primal Problem: 


2 aij. Xj — bi = -yi, 7 € R (row index) 


jeEC 
(11) 
py cj.xj) -O =f (function to be maximized) 
jeC 
Dual Problem: 
2 Vi. aij — cj = uj, j © C (Column index) 
i¢€R 
(12) 


Ly vi.bi -O = g (function to be minimized) 
i¢€R 


wherein the variables x;, yi, Vi, uj are all considered to be non-negative. 


3. ALGEBRA (ARITHMETIC) OF SYMPLEX PIVOTING PROCESS 


With the Goldman-Tucker Compact-Symmetric-Tableau (CST) representation for linear 
programming, in its standard/canonical form, one can observe that once a pivot element is selected, 
the actual pivoting process (the algebra and hence the arithmetic operations) is the same 
irrespective of the pivot selection; for example whether it is a primal pivot or a dual pivot. Hence 
it suffices to present here 


De and along with 
the and the (as will be evident later) are the reasons why the above 
representation has been selected for the purpose of our study. 


For the sake of generality, let us imagine that we are somewhere in the middle of solving a LP 
problem (say after the k" iteration), and have the system model represented by a tableau (T;) as 
shown in Figure-2. 


By the nature of the sequence of elementary row (column) operations being performed during any 
pivoting process, the system model represented in Figure-2 is equivalent to that represented by the 
initial tableau which corresponds to the P-D pair (11) & (12). The transformed version of the 
primal-dual pair directly expressed by the above tableau is as follows: 


S<p-d-s-p-d-s PIPR:©: Dr.(Prof.) Keshava Prasad Halemane Page 5 of 24 


6=p=d=s=p-d-=s PIPR:©: Dr.(Prof.) Keshava Prasad Halemane Page 6 of 24 


lit —1 

win Oiij Bi | = —2iP 
Ue Hl 
Wj g 


Figure-2: Compact Symmetric Tableau (Tx) after k iterations 


Primal Problem: 


7 = B- y aij.z)X, i € R (row index) 
jeC 
(13) 
f = -8+ 2 yj .ziN, (function to be maximized) 
jeC 
Dual Problem: 
we =-y+ 7 wiN. aij, j € C (column index) 
ig€R 
(14) 
g =-6+ » wiN. Bi (function to be minimized) 
ig€R 


The effect of a pivoting operation on (13) & (14) performed with a chosen pivot element ay is 
exactly to affect an exchange between the P-D variable pairs indicated by I and J in (13) and (14). 
That is, zy‘ is entered into primal basis in exchange for zy" in (13), and wy’ is entered into dual basis 
in exchange for w;® in (14). Suppose we have chosen the pivot element ay using some appropriate 
pivot selection scheme, and we would like to derive the resulting tableau (Tx+1). Let the resulting 
tableau (Ti+1) be indicated in Figure-3. 
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(7) -1 
(wid)' (a4i)' (Bi)’ | = —(zi®)' 
=| (yi) (5) j=f 

ll ll 

(wjP)' g 


Figure-3: Compact Symmetric Tableau (Tx+1) after (k+1) iterations 


The algebra (arithmetic) of derivin 


the above tableau (T+1) of Figure-3 from the previous tableau 
(T.) of Figure-2 is detailed below (iti er 


along with an exchange of labels associated with row I and column J; that is effectively: 


while retaining the very same labels for all the other rows and columns; that is: 


It is to be noted here that the 


. Also, the tableau evolves from To as the initial tableau 
representing the problem in its standard canonical form, while following the sequence of symplex 
iterations all the way to the final terminal tableau T:, while always being a tableau representation 
of an equivalent system of linear inequalities along with the corresponding objective function. 


From (13) & (14) above, we can get: 


(f+8) + 2 Weezy = » bs wi. aj. z)N = (g+5) — » Wea | 15) 


and therefore, 


(g—f) = ) win. zB + ee (16) 
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The values of the primal and the dual basic variables as well as (the primal & the dual) objective 
function value corresponding to a basis/tableau can be directly read from the entries of the tableau 
- the primal objective function value being always the same as the dual objective function value for 
every basis/tableau all along the sequence of symplex iterations - each of the summation terms in 


both (15) and (16) above being zero, and the complementary slackness condition being 
aI ee The relationships (15) & (16) above indicate the 


effect of moving away from a basis, as the non-basic variables are moved away from zero; in 
particular, one can note from (16) above that for all feasible solutions, the dual objective function 
value is an upper bound for the primal objective function value and the primal objective function 
value is a lower bound for the dual objective function value, which is a well known relationship. 


Now, one may skip Sections 4 to 8 and go directly to Section 9 in order 
to avoid a pedagogical detour, and possibly come back to these sections 
if and when necessary to fill the gaps in one’s detailed understanding. 


4. A TYPICAL SYMPLEX PIVOT SELECTION 


A typical symplex pivot selection scheme can include four (two pairs) fundamental types of 
symplex pivot selections - the are the 
classical pair defined by Dantzig [1]. Here, we define a new pair of pivots - 
(PTP) and . The algebra of these pivot selections is given in Figure-4, 
along with a schematic representation of the Tableau Data Pattern that leads to such pivot selection. 


5. EFFECT OF A TYPICAL PIVOTING OPERATION 


It is useful at this point to make a few observations regarding the effect of pivoting operation, in 
each of the above pivot selections. 


DSP {poxidixi} brings about an immediate improvement in the primal feasibility w.r.t. the pivot 
row, without deterioration of dual feasibility. The extent of this improvement in primal feasibility 
can be measured by the corresponding improvement (decrease) in the value of the dual objective 
function, given by a local effectiveness measure lem(L, J) = abs{ysx(an)'Br} [refer Section-8]. 


PSP {doxipixi} brings about an immediate improvement in the dual feasibility w.r.t. the pivot 
column, without deterioration of primal feasibility. The extent of this improvement in dual 
feasibility can be measured by the corresponding improvement (increase) in the value of the primal 
objective function, given by the same local effectiveness measure as mentioned here above. 


PTP {poxidoxo} brings about an immediate improvement in the primal feasibility w.r.t. the pivot 
row, without any concern to the dual feasibility. The extent of this improvement in primal 
feasibility can be measured by the corresponding improvement (increase) in the value of the primal 
objective function, given by the same local effectiveness measure as mentioned here above. 


DTP {doxipoxo} brings about an immediate improvement in the dual feasibility w.r.t. the pivot 
column, without any concern to the primal feasibility. The extent of this improvement in dual 
feasibility can be measured by the corresponding improvement (decrease) in the value of the dual 
objective function, given by the same local effectiveness measure as mentioned here above. 
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(a) Dual Standard Pivot, DSP: {poxidixi} 


e — I € {ie R |i <0}; 
ei/el@ Jposp(I) <— ee {(yj/ay) | yj <03 oj < 0}; 


[ore 
1 


(b) Primal Standard Pivot, PSP: {doxipixi} 


= Te{ ec | y +0}, 
Ei => Ipsp(J) <— arg-min {( Bi/ ais) | Bi = 0; ais > O}; 
i€R 


| I € {ie R| Pi<0}; 
® Jpre(]) <— arg-max {abs( yj / a) | ay <0; yj > O}; 
jEC 


[rete 
L 


(d) Dual Tricky Pivot, DTP: {doxipoxo} 


e|[-|- F€ (7EC |e Of 
e e/a Ipre(J) <— arg-max {abs( Bi / ais) | air > 0; Bi < O}; 
i€R 
[etete 
t 


Figure-4:. Four Types of Typical Symplex Pivot Selections 


— negative; 0 zero; + positive; © non-positive; * any value; ® non-negative; © un-analyzed 


6. CHARACTERIZATION OF A PIVOT ELEMENT/CELL 


Each potential pivot element/cell in the Compact Symmetric Tableau (CST) is characterized by a 
“cell-type”. The cell type of a cell in I" row and J“ column consists of three components. They are 
the sign of a1 (either ‘0’, ‘+’ or ‘—’), the sign of Br (either *Z’, ‘P’ or ‘N’) and the sign of y; (either 
‘Zz’, ‘p’ or ‘n’). Hence there will be a total of 27 different cell types. However, if a is zero or 
numerically near-zero, it will not be a potential pivoting cell, since pivoting will not be performed 
on such cells. Hence the nine cell types with a ~ 0 are combined together and the new cell type 


given is 0**. Thus there are 19 cell types for our consideration. 
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7. TYPICAL SYMPLEX PIVOT DECISION STRATEGY 


The four distinct types of typical pivot selections mentioned above may be considered for 
designing a pivoting strategy. 


The four distinct types of typical pivot selections may be considered in the following default 
preference order: {{DTP,PSP},{PTP,DSP}} to drive towards dual feasibility first; or alternatively 
{{PTP,DSP},{DTP,PSP}} to drive towards primal feasibility first. 


At every iteration, an attempt is made to select a pivot element/cell, by checking the possible pivot 
selections belonging to one of the above four types of pivot selections in the default preference 
order as specified above. It is to be noted that depending upon the actual data in the Tableau, a 
pivot selection of specific type which was not possible in an earlier iteration, can become possible 
in a later iteration, sometimes even in the very next following iteration. That is why it is a crucial 
part of an algorithm to check in each (and every) iteration, for each of the four types of possible 
pivot selections preferably (although not necessarily) in a pre-specified preference order. At each 
step mentioned above, if there is more than one pivot element of that particular cell type, then the 
choice can be narrowed by utilizing some measure of goodness for the pivot selection, appropriately 
defined. 


8. MEASURE OF GOODNESS FOR PIVOT SELECTION 


From the earlier discussion above, one can observe that the absolute value of the change in the 
objective function, can possibly be utilized as a local effectiveness measure (lem) of the pivoting 
operation - applicable for any and every iteration, for both primal as well as dual — that is, given by 


Although it is not specifically suggested here, one can opt to choose a pivot, possibly to maximize 
this local effectiveness measure (lem) in every iteration, either among the possible pivots of a 
particular type or subtype, or even among of all the possible pivots of all the four possible types. 
Even, if done so, it cannot be guaranteed (needs further research?) to minimize the overall number 
of symplex iterations required for reaching an optimum solution. 


It may require further research work to thoroughly understand, analyze and incorporate the concept 
of any “local effectiveness measure” (lem) for a single symplex pivoting operation to the fullest 
extent, that would in effect achieve a een neal in some corresponding "global 

‘J (gem) defined appropriately for the given LP problem; in developing an 
efficient & robust solution strategy. For now, let us come to the main algorithm itself. 


In order to achieve a guaranteed performance efficiency, we propose to utilize a global 


that characterizes a CST tableau with a number indicating 
the 
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9. INFEASIBILITY INDEX : A GLOBAL EFFECTIVENESS MEASURE 


As an , the of a given CST tableau is defined as 
the sum of the and the . It corresponds to the 
number of basic variables in primal & dual which are infeasible in the given tableau. That is, we 


define fen: and therefore - 


X= (u, number of rows with B <0) +(v, number of columns with y > 0); 
or 
X= (pu, number of rows with z;® < 0) + (v, number of columns with w;® < 0). 


. By the definition of the infeasibility index, it 


can never be negative, nor can it be more than the sum of the number of columns and the number 
of rows in the Compact Symmetric Tableau. That is, 


Given a tableau, the change in the infeasibility index (t= Ad) can be associated with each cell that 


can be a potential candidate pivot element (i.e. 0 #0). This change in the infeasibility index consists 
of two components, one is the and the other is the 


. That is, 


9.1 Calculation of the change in the primal infeasibility index (o = Ap) 


For each column j, the ratio rj = B;/oij is calculated for all rows i = 1, 2, ..., m. 
The ratio can either be positive, zero or negative. It can be represented as in Figure-5. 


Let ay be the chosen pivot element, then after pivoting, the values of B are given by 


ry = Bay and 


(Br)’ <— (Br/ou) 
and (Bi)? — Bi — (Br/an)ais 


The calculation of o can be divided into three different cases depending upon the value of ry. 
B = 0 is considered as feasible. 


(i) my=0 (Pr=0, ay #0) 


Here, there will not be any change in the B values, and therefore there will not be any change in the 
infeasibility index. Hence, oy = 0. 


(ii) O0<ry (0<f1,0< ay : pixi -or- Bi< 0, ay <0: poxi) : b-p 


riy < 0 will not affect the change in the infeasibility index. riy < 0 can occur in two situations. 
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One of them is when B; < 0 and aj > 0. In this case, it can be seen from the expression for (Bi)’ 
given above, that (i)’ will continue to be negative; hence the change in the infeasibility index is 
not affected. 


The other is when B; > 0 and ais < 0. In this case, it can be seen from the expression for (B;)’ given 
above, that (Bi)’ will continue to be positive; hence the change in the infeasibility index is not 
affected. 


riy > O will affect the change in the infeasibility index. rjy > 0 can occur in two situations. 


One is when fj > 0 and ai; > 0. In this case, it can be seen from the expression for (Bi)’ given above, 
that (Bi)’ will continue to be positive for the ratios riy > rij, (Bi)’ will be zero for the ratios ri = ry, 
(B1)’ will continue to be positive, and (Bi)’ will become negative for the ratios rjy < ri. Hence the 
change in the infeasibility index is increased by the number of ratios riy which are less than ri and 
greater than or equal to zero. 


The other is when fi < 0 and aj < 0. In this case, it can be seen from the expression for (Bi)’ given 
above, that (B;)’ will continue to be negative for the ratios rij > riy, (Bi)’ will become zero for the 
ratios riy = ry, (B1)’ will become positive, and (B;)’ will become positive for the ratios riy < ry. 
Hence the change in the infeasibility index is decreased by the number of ratios rij which are less 
than or equal to ry and strictly greater than zero. 


Therefore, 
b=ZNo. of rows iwithO< Bi, 0 <aiy and O<ry<ry : {pixi} 
p= No. of rowsi with Bi <0, ai <O and O<ry<ry : {poxi} 
and 
oy =b—p : {pixi-poxi} 


r<0O O<r 


Figure-5: Ordered Pattern of {riy = (Bi / aiy)} Values for i= 1, 2, ...,m 
* => (‘P’ or ‘N’ or ‘Z’) 
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dij) 3 ory<0O (O<f1, ay <0: pixo -or- Br < 0,0 < ay : poxo) : 1+q-d 
riy > O will not affect the change in the infeasibility index. rjy > 0 can occur in two situations. 


One of them is when fj > 0 and aj > 0. In this case, it can be seen from the expression for (Bi)’ 
given above, that (Bi)’ will continue to be positive; hence the change in the infeasibility index is not 
affected. 


The other is when B; < 0 and ais < 0. In this case, it can be seen from the expression for (Bi)’ given 
above, that (B;)’ will continue to be negative; hence the change in the infeasibility index is not 
affected. 


riy <O will affect the change in the infeasibility index. rij < 0 can occur in two situations. 


One is when fj; > 0 and ai < 0. In this case, it can be seen from the expression for (B;)’ given above, 
that (Bi)’ will continue to be positive for the ratios riy < rij, (Bi)’ will be zero for the ratios ri = ry, 
(B1)’ will become negative, and (f;)’ will become negative for the ratios riy > r1y. Hence the change 
in the infeasibility index is increased by the number of ratios riy which are greater than ry and less 
than or equal to zero (one more, if Br is positive, since it will become negative). 


The other is when fi < 0 and aj; > 0. In this case, it can be seen from the expression for (i)’ given 
above, that (Bi)’ will continue to be negative for the ratios rij < rqy, (Bi)’ will become zero for the 
ratios ry = ry, (Br) will become negative, and (B;)’ will become positive for the ratios riy > ry. 
Hence the change in the infeasibility index is decreased by the number of ratios riy which are greater 
than or equal to ryy and strictly less than zero (one less, if Br is negative, since it will continue to be 
negative). 


Therefore, 
q=2ZNo. of rowsi with 0 <Bi, ais <O and ry < ri <0 : {pixo} 
d= No. of rowsi with Bi <0, 0< ai and ry <riy <0 : {poxo} 
and 


oy =(q+1)-d if (Br > 0) 
or oy =q—(d-1) if (Br < 0) 
Hence we get, 
oy =l1+q-d : { lpixo-poxo} 


9.2 Calculation of the change in the dual infeasibility index (p = Av) 


For each row 1, the ratio rij= y;/oi is calculated for all columns j = 1, 2, ..., n. 
The ratio can either be positive or negative. It can be represented as in Figure-6. 


Let ay be the chosen pivot element, then after pivoting, the values of y are given by 
ry = y/oy and 


(ys) — — (y/o) 
and (vi) — yi — (y/an)ay 
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The calculation of p can be divided into three different cases depending upon the value of ryy. 

y = 0 is considered as feasible. 

(i) m=0 (y7=0, ay #9) 


Here there will not be any change in the y values, and therefore there will not be any change in the 
infeasibility index. Hence, pu = 0. 


Figure-6: Ordered Pattern of {r1j = (yj / a1j)} Values for j = 1, 2, ..., n 


* => (‘p’ or ‘n or ‘Z’) 


Gi) O<ry (yy <0, 01 <0: dixi -or- ys > 0, a1 > 0: doxi) :p-b 
ry < 0 will not affect the change in the infeasibility index. mj < 0 can occur in two situations. 


One of them is when yj; < 0 and a > 0. In this case, it can be seen from the expression for (y;)’ given 
above, that (yj;)’ will continue to be negative; hence the change in the infeasibility index is not 
affected. 


The other is when yj > 0 and oy; < 0. In this case, it can be seen from the expression for (y;)’ given 
above, that (y;)’ will continue to be positive; hence the change in the infeasibility index is not 
affected. 


ry > O will affect the change in the infeasibility index. rj > 0 can occur in two situations. 


One is when y; < 0 and oy < 0. In this case, it can be seen from the expression for (yj)’ given above, 
that (yj;)’ will continue to be negative for the ratios ry > ry, (yj)’ will be zero for the ratios ryj= ry, 
(ys)’ will continue to be negative, and (yj;)’ will become positive for the ratios ry < ri. Hence the 
change in the infeasibility index is increased by the number of ratios rij which are less than rig and 
greater than or equal to zero. 
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The other is when yj > 0 and oy; > 0. In this case, it can be seen from the expression for (yj;)’ given 
above, that (yj)’ will continue to be positive for the ratios ry > ry, (yj)’ will become zero for the 
ratios ry = ry, (ys)’ will become negative, and (yj)’ will become negative for the ratios ry < ry. 
Hence the change in the infeasibility index is decreased by the number of ratios rj which are less 
than or equal to ry and strictly greater than zero. 


Therefore, 

p= ZNo. of columns j with yj <0, aj <O and O<ry<ry : {dixi} 

b=Z No. of columns j with 0<y;, 0 <a and 0<ryj<ry : {doxi} 
and 

pu =p—b : {dixi-doxi} 
dii) ory <0 (yy <0,a1>0: dixo -or- yy >0, a1y <0: doxo) : 1+d-q 


ry > O will not affect the change in the infeasibility index. rj > 0 can occur in two situations. 


One of them is when y; < 0 and oj < 0. In this case, it can be seen from the expression for (y;)’ given 
above, that (y;)’ will continue to be negative; hence the change in the infeasibility index is not 
affected. 


The other is when y; > 0 and oy > 0. In this case, it can be seen from the expression for (yj)’ given 
above, that (yj)’ will continue to be positive; hence the change in the infeasibility index is not 
affected. 


ry <0 will affect the change in the infeasibility index. ry < 0 can occur in two situations. 


One is when y; < 0 and oy > 0. In this case, it can be seen from the expression for (yj)’ given above, 
that (yj;)’ will continue to be negative for the ratios ry < rq, (yj)’ will be zero for the ratios ryj= ry, 
(ys)’ will become positive, and (y;)’ will become positive for the ratios ry > ry. Hence the change 
in the infeasibility index is increased by the number of ratios ry which are greater than ry and less 
than or equal to zero (one more, if yy; is negative, since it will become positive). 


The other is when yj > 0 and ay < 0. In this case, it can be seen from the expression for (yj;)’ given 
above, that (y;)’ will continue to be positive for the ratios ry < ri, (yj)’ will become zero for the 
ratios ry = ry, (ys)’ will become positive, and (y;)’ will become negative for the ratios ry > ry. 
Hence the change in the infeasibility index is decreased by the number of ratios Ry which are greater 
than or equal to ryy and strictly less than zero (one less, if ys is positive, since it will continue to be 
positive). 


Therefore, 
d= No. of columns j with yj;<0,0 <oj and ry <ry<0 : {dixo} 
q =X No. of columns j with 0 <y;,0j<0 and ry<riy <0 : {doxo} 
and 


pu =(d+ 1)—q if (ys < 0) 
or pu =d—(q-1) if (y1 > 0) 
Hence we get, 
pu =1+d-q :{ 1dixo-doxo } 
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10. CST-SIGNATURE OF A COMPACT SYMMETRIC TABLEAU 


We have designed a unique CST-signature that distinctly identifies any specific Goldman-Tucker 
Compact Symmetric Tableau associated with a given Linear Programming Problem. It is a string 
of length n+m (number of columns + number of rows). The first n entries are chosen from the 
character set {n, z, p} depending upon whether the y value is negative, zero or positive respectively; 
the next m entries are chosen from the character set {P, Z, N} depending upon whether the B value 
is positive, zero or negative respectively. The positions of these entries in the signature string are 
fixed conveniently with respect to the initial tableau, as in considering the lexicographic ordering 
of these n+m parameters. As part of the pivot selection process, during the infeasibility analysis, 
corresponding to a specific possible choice of the pivot element, the CST-signature string can be 
generated for the anticipated resultant tableau. It can be compared with the signatures of all the 
previous tableaus stored in a dictionary, to facilitate the detection of any possible imminent cycle, 
since each CST-tableau has a unique CST-signature and each CST-signature uniquely identifies a 
CST-tableau. If&when an imminent cycle is detected, such pivot choice can be avoided and 
possible alternative pivot choice may be considered for actual pivoting operation. This 
methodology will be useful especially in situations of degeneracy. Note that an alternative 
may be defined by mapping the alphabet symbols {n,z,p} to 0 
indicating the primal non-basic status, and mapping the alphabet symbols {p,Z,N} to | 
indicating primal basic status, of the corresponding parameters, as a framework to represent 
only the combinatorial information without any reference to the feasibility information. 


11. DEGENERACY 


When no further decrease in the infeasibility index is indicated by every/all possible pivot selections 
(the best pivot choice corresponding to the largest possible decrease - non-increase - in the 
infeasibility index is itself a case of no change in the infeasibility index) the situation may 
correspond to either of the two cases: (1) the tableau is indeed the terminal tableau, or (2) the best 
possible choice of the pivot element is in some degenerate row/column. In the first case, the 
spdspds algorithm terminates and the tableau may be analyzed to classify it into one of the six 
possible categories as described later. The presence of primal/dual degeneracy (either in the 
terminal tableau itself, as in the first case, or may even be some temporary/intermediate degeneracy 
encountered enroute towards the optimum/terminal tableau, as in the second case) may be identified 
by the presence of zero in some row/column. The situation wherein the best pivot choice is itself 
in some degenerate row/column, requires further analysis, before declaring that the tableau is 
indeed the terminal tableau - it may indeed be either a case of temporary/intermediate degeneracy 
or a case of degeneracy in a non-optimum but terminal tableau. 


A pivot selection on any degenerate row/column with primal/dual degeneracy doesn’t lead to any 
change in the primal/dual feasibility (refer to the algebra/arithmetic of the pivoting process 
presented in Section-3) although the coefficient matrix entries will surely be changed in the 
resulting tableau. Therefore, the infeasibility analysis needs to be carried out for the resulting 
tableau so as to check & confirm whether any further reduction in the infeasibility index is now 
attainable - if so, the usual iteration process continues; if not, then further pivoting on the degenerate 
rows/columns needs to be continued (as per a predetermined lexicographically ordered sequence 
of the problem parameters) among those possible pivot options while also keeping track of the 
CST-signature of the tableaus to detect & avoid possible impending cycling. 
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12. ALGORITHM TERMINATION - TERMINAL TABLEAU TYPES 


When further reduction in the infeasibility index is not possible, the tableau is checked & confirmed 
to be the terminal tableau. The possible terminal tableau types as shown in Figure-7 belong to one 


of the six possible categories listed here. Label F is for feasible-basic-finite, a) for feasible basic- 
a ee and ® for infeasible - corresponding to both primal and dual variables. 


D = F D = o D = © 
1 
| 
| 
P=F 
| 
P=0 
{ 
| 
P=®0 
H 
I 
I 


Figure-7. Six Categories for Terminal Tableau Data Pattern. 
— negative; O zero; + positive; 
© non-positive; * any value; © non-negative; @ un-analyzed 


This classification into six categories as presented here is a refinement over the well-known 
classical approach; one that enables to distinctly identify the case wherein primal (dual) has a 
feasible basic-finiteon-basic-infinite optimum with finite value for the objective function, while 
the dual (primal) has a feasible-basic-finite optimum. This distinction from the classical approach 
arises because we give primary emphasis on the classification based on the nature of the decision 
variables at termination, and give secondary emphasis on the finiteness (or otherwise) of the 
objective function value. The set of criteria for this classification scheme, to be used after ensuring 
that the tableau is indeed the terminal tableau, is given along with Figure-7. 


Note that the situations ot a to primal/dual degeneracy with the resultant dual/primal 


and also that of are all easily discernible in this classification scheme. 
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In case of terminal infeasibility, a judicious use of either the change in primal infeasibility index 
(o=Aun) or change in dual infeasibility index (p=Av) instead of the change in overall infeasibility 
index (t=Ad) can be utilized to arrive at an almost primal feasible or an almost dual feasible tableau, 
if one requires such an output for further problem analysis etc. This maneuverability can be adapted 
to the needs of the problem and that shows the 


13. SYMMETRIC PRIMAL DUAL SYMPLEX PIVOT SELECTION STRATEGY 


(1) The proposed spdspds approach can be used to solve any LP problem, by first converting it into 
the before proceeding further. In performing such transformation, it is 
possible to enhance the overall efficiency by the following approach: 


(a) Free/bounded variables can be replaced by non-negative variables not double in number, but 
only just one extra in number. Equations can be replaced by inequalities not double in 
number, but only just one extra in number. 


(b) No need for use of artificial variables; the initial basic solution need not necessarily be 
feasible; and therefore no need to rely on two-phase method or big-M method, etc. 


(2) Any nonzero element of the coefficient matrix in the tableau can be a potential pivot element. 
The earlier defined typical symplex pivot selection scheme and the associated set of four types of 
pivot candidates {{DTP, PSP},{PTP, DSP}} is a typical sample, presented (refer Sections 4-to-8) 
only for pedagogical reasons, to eventually take the reader towards the proposed spdspds. Note 
that the classical PSP (doxipixi pivot) with cell-type +Pp and DSP (poxidixi pivot) with cell-type — 
Nn are the most often encountered ones simply because of their classical appeal. Although a 

with cell type —Pp or a er ec with cell-type +Nn may usually seem to be 
simply unacceptable or extremely unlikely, it may indeed turn out that such a pivot choice can yield 
a surprisingly large decrease in the infeasibility index, depending on the tableau data entries, 
especially as an intermediary pivoting iteration, and therefore worth the consideration. The 
versatility of our spdspds algorithm allows for such pivot selection decisions. 


(3) The proposed concept of infeasibility index along with the use of a measure of goodness for the 
pivot selection determined as/by the anticipated iM corsidercd as a 

arising due to the specific pivot selection, turns out to be 
a in the use of symplex 
method for solving linear programming problems. One can use either o (if m <n) or p Gfn<m) 


as a tie-breaking measure to choose among alternatives having the same value for t. Also note that 
the 
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(4) Problem of cycling en-route towards the terminal tableau, possibly caused by some intermediate 
will get prevented because of the very nature of the spdspds pivot selection strategy, 
seeking the best possible decrease of the infeasibility index through a non-degenerate pivot. If and 
when encountered with a possible degeneracy that seems to block further progress in decreasing 
the infeasibility index, the lexicographic ordering of the variables may be used as a tie-breaking 
mechanism to guide the choice of pivot element, thus coursing through a part of the cycle, until a 
point is reached wherefrom spdspds finds a step down the infeasibility path again, unless it happens 
to be the terminal tableau. So, 


(5) Potential possibility of can be avoided by careful elimination of poor 
, using - even if it requires going for a next-best 


pivot choice in terms of gem (decrease in the infeasibility index) - in order to avoid such treacherous 
pathways leading to numerically disastrous computational behavior - that is effectively like first 
exchanging I for K followed by an exchange of K for J in order to achieve an exchange of I for J - 
equivalent to using an appropriate pre-conditioner without actually doing so. 


14. COMPUTATIONAL COMPLEXITY 


For a linear programming problem represented in its standard canonical form using the CST of 
size (m)x(n) the can be taken as ~ [ 


In the worst-case, the infeasibility index of the initial tableau will at most be {(m)+(n)} and at each 

spdspds symplex pivoting iteration the infeasibility index gets reduced by at least one so that it 

takes at most {(m)+(n)} spdspds symplex pivoting iterations to reach the optimum solution if one 

exists; or may even be well before that in order to report the infeasibility status of the given problem. 

Therefore, the number of spdspds symplex pivoting iterations required to solve the linear 
roblem is, O(L"”) in the worst-case. However, the 


Each spdspds symplex pivoting operation requires a complete 
before performing the actual pivoting operation, and that itself requires <[2*(m)*(n)] floating point 
operations, that is O(L). Each spdspds symplex pivoting operation requires <[3*(m+1)*(n+1)] 
floating point operations, which is again O(L). 


Thus, the involved in solving the linear programming problem is 
, which is of course 


It can be shown easily that the space complexity is only O(L) - that is, linear complexity bound. 


Note that spdspds has finite termination and provides a definite output, that is, either the optimum 


solution if & when one exists, or a point of minimal infeasibility beyond which no further spdspds 
symplex pivoting is possible towards any improvement in the feasibility of the given problem - 
which itself may provide insight as to the possible refinements in the problem formulation itself. 
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15. DIRECTIONS FOR FUTURE RESEARCH 


1: Analyze the entries in the initial tableau To and make a statement regarding the basic/non-basic 
status of each of the variables in the optimum tableau Ts. This question is conceptually equivalent 
to asking, in the context of non-linear programming [11] as to whether a constraint will be active 
(non-basic) or otherwise at the optimum - although of course expecting an answer in that context 
may certainly not be practical. However, the situation with linear systems can be more promising 
so as to expect a possible attempt in answering that question - based only on a thorough analysis of 
either the initial tableau To, or equivalently, any tableau T; en-route towards the optimum - using a 
radically redefined concept of [8][12][13] constraints - implicitly achieved by 


the spdspds algorithm as explained herein below: 


Q: is there any further improvement possible beyond this? Suppose there exists a row icR 
having its ratio Bi/ai; for every column jéC that is closer to (no farther from) zero relative 
to the set of ratios {Tines1j)} - can we say that such a row (binding?row) will certainly be 
pushed to primal non-basic status by some pivoting operation? Suppose there exists a 
column jéC having its ratio y;/aij for every row i€R that is closer to (no farther from) zero 
relative to the set of ratios {rjnegwi)} - can we say that such a column (binding?column) will 
certainly be pushed to primal basic status by some pivoting operation? 
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3: The combined effect of a simultaneous application of more than one symplex pivot (rather than 


a is indeed worth further detailed study, and can possibly 
lead to what may be called as the general ; 


4: The versatility of the spdspds algorithm allows for extensive combinatorial analysis along with 
numerical experimentation to explore further possibilities, including possible applications in 
polyhedral combinatorics, network optimization, etc. Also, for example, as in the classical 
approaches, one can possibly seek to first achieve primal or dual feasibility, more efficiently, by 
utilizing the best possible decrease in the corresponding component - either o or p rather than 1, 
before going further with later iterations. 


16. A POSER TO THE COOL-HEADED BRA VE-HEARTS 

Here, we present a poser to you, our cool-headed brave-heart counter-part: 

Refer to the notation used in Figure-4 and consider the two scenarios described below: 
[VIeER]:[AJeC{ {I=Ipsp(J) }V (I= IpreJ)} }]; & [WJ eC]:[AleR{ {J=Iose(D) }V {J=Jpre(D } }; 
or the scenarios described below: 


[vIeR]:[AaJeC{ vieR { (BE0)A(O<Pr/an<Bi/ais)V(Bi/cuj<Prv/ar<0)) } V { (Bi<O)A((OSPi/ais<Pr/an)V(Bv/an<Pi/ais<0)) } } ]; 
& 

[veC]: [ATER { Vj eC{ (ys<0)A((OSys/cur<yj/cu4)) V(yi/ouj<y/ <0) } V { (ys>0)A((OSyi/aj<ys/ xs) (ys/c4<y;/045<0)) } } J; 
and then may even possibly consider the scenarios described below: 
[{(VIER)(AJEC)}:{(WieR)(ou < o7 < 0)}] & [{(WJeEC)(AIER) }:{(VjeC)(pu < py < 0) } I; 

A careful reading of the above will reveal that the underlying reasoning here is what leads to the 


concept of infeasibility index asa for a symplex pivoting operation 
that form the conceptual foundation for the design of spdspds expressed by the following: 


A careful reading of this entire report will convince you that the spdspds algorithm has been 
designed with strong/rigorous logical/mathematical justification at every step. 


17. CONCLUSION 


CST tableau. The as a (gem) 
associated with each potential pivot element forms the basic foundation for the proposed spdspds 
algorithm. Also note that the 
. From an Engineer’s point of view, scaling of the rows and columns is 
equivalent to expressing the problem parameters (both dependent variables and independent 
variables) in a re-defined set of units-of-measurement - appropriately chosen, as a preconditioning 
step that may be required to improve the numerical stability of the overall computational process. 
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The proposed spdspds algorithm provides a novel viewpoint to the very same classic framework of 
Goldman-Tucker Compact-Symmetric-Tableau representation for LP - with a newly defined 
concept of symplex pivot; leading to an efficient, robust and versatile iterative solution strategy 
passing through a non-repetitive sequence of symplex tableaus requiring minimum number of 
symplex iterations, with a worst-case computational complexity of O(L'”). 


The proposed concept of the CST-signature can be utilized to keep track of the computational path 
from the initial tableau to the terminal tableau, and for advance detection of possible cycling before 
it actually occurs - even though of course the spdspds algorithm is effectively immune to any 
cycling caused by possible intermediate degeneracy. 


For the first time in the history of Linear Programming, we have achieved - 

(0.0) effective utilization of the Goldman-Tucker Compact-Symmetric-Tableau (CST) which is a 
unique symmetric representation common to both the primal as well as the dual of a linear 
programming problem in its standard canonical form, and in which the algebra/arithmetic of the 
pivoting operation also gets represented by a unique single set of operations irrespective of 
whether it is a primal pivot or a dual pivot; 

(1.0) with ‘symplex’ - a new avataar of ‘simplex’ in the 21st century, the concept of 

(2.0) infeasibility-index for a P-D pair has been defined and effectively used as a 

(3.0) global-effectiveness-measure, in the design of 'spdspds' algorithm, 

to guide the pivoting process, with five guarantees - 

(3.1)* improvement of the overall P-D feasibility at every iteration, 

(3.2)* immunity against cycling, 

(3.3)* finite termination, 

(3.4)* minimum number of spdspds symplex pivoting iterations, 

(3.5)* worst case computational complexity of O(L'*) - 

(4.0) with a re-defined concept of binding / non-binding constraints implicitly incorporated - 
(5.0) by this Game-Changer 'spdspds' Algorithm, 

claiming to be the Great Grand Breakthrough, having successfully resolved-&-reposed the 
Linear Programming Performance Challenge of the millennium - 

refer to the 9th among the 18 “Mathematical Problems for the Next Century” [14][15] - 
(6.0) with consequent immediate as well as lasting, deep as well as far-reaching impact 
on the study, teaching and application of Linear Programming and Algorithms in 
particular as well as Computational Complexity Analysis in general. 


The Linear-Programming Grand-Master reads “‘spdspds’ as ‘yes-speedy-yes-speedy-yes’ 
(yes! - why silent?) while rejoicing its 180-degree rotational symmetry as a string symbol. 
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Online E-print Repository; the reason given was: “The report seems wrong’! 


On the auspicious vidyaa(vijaya)daSami day [20200CT25] I wish to share my pleasure in giving 
anew name as ale pivot’ to the now redefined simplex pivot, emphasizing the primal-dual 
symmetry therein, along with the expanded scope in terms of the far wider range of choices 
available in the selection of such pivot element, while maintaining the minimal 


, in the Goldman-Tucker Compact Symmetric 
Tableau (CST) which is a unique symmetric representation common to both the primal as well as 


the dual of a linear programming problem in its standard canonical form. This renamin 
acknowledges that ou ji zie a a, 


although after well over seven decades, now as a new avataar in the twenty first century. 


20. DEDICATION 


To my e9% (aja) & e9% (ajji) & Karinja Halemane Keshava Bhat & Thirumaleshwari and to my e9@3, (appa) 


& eed, (amma) Shama Bhat & Thirumaleshwari for their teachings through love, that quality matters more 


than quantity; to my wife Vijayalakshmi for her ever consistent love & support; to my daughter Sriwidya.Bharati 
and my twin sons Sriwidya.Ramana & Sriwidya.Prawina for their love & affection. 


To all the cool-headed brave-hearts, eagerly awaited but probably yet to be visible among the world 
optimization professionals, who would be attracted to and certainly capable of effectively understanding 
without any prejudice and appreciating the deeper details enshrined in 'spdspds', who may opt for ‘symplex’ 
over ‘simplex’ and ‘spdspds’ over any other strategy for solving linear programming problems. 
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